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(54) Image scrambling method and apparatus therefor 



(57) The present invention relates to an image 
scrambling method and apparatus. The apparatus com- 
prises a first dividing decoder for dividing the MPEG 
encoded image data stream into a plurality of data seg- 
ments (for example, macro blocks or slices); at least one 
arrangement table recording arrangement information 
to be used for arranging the data segments; an arrange- 
ment circuit for arranging the data segments output 
from the first dividing decoder in accordance with the 
information recorded in the arrangement table to output 



a scrambled image data stream; a second dividing 
decoder for dividing the scrambled image data stream 
into a plurality of data segments; at least one rearrange- 
ment table recording rearrangement information to be 
used for rearranging the data segments output from the 
second dividing decoder; and a rearrangement circuit 
for rearranging the data segments output from the sec- 
ond dividing decoder in accordance with the rearrange- 
ment information recorded in the rearrangement table. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] This invention relates to a method and appara- 
tus for scrambling and unscrambling image data using 
an MPEG encoding digital video system. 

Background Art 

[0002] In previous methods for scrambling MPEG 
encoded images, the MPEG encoded video data are 
scrambled by disassembling the data into bit units and 
reassembling the disassembled data using an algorithm 
which has no relation to the MPEG encoded images 
itself. Therefore, the image data scrambled by this 
method becomes completely non-viewable/non-visible. 
[0003] However, the MPEG decoding system does not 
recognize the image data scrambled by the above 
method as video data which are encoded by MPEG 
standards, and the risk arises that the MPEG decoder 
will malfunction or will be broken down when the scram- 
bled data are input. 

[0004] Furthermore, because the image data scram- 
bled by the above method is completely non viewable 
before the unscrambling of the data, even users having 
permission to unscramble the scrambled data cannot 
recognize whether the receiving data are the scrambled 
video data or mere noise. Therefore, unless the sender 
of the scrambled data informs the receiver that scram- 
bled data are being transmitted, the receiver cannot 
unscramble the transmitted data to see the original 
image data. 

[0005] In order to solve the above problems, in the 
method for disassembling video data into bit units and 
reassembling using an algorithm having no relation to 
the MPEG encoded video data, it is effective to leave 
part of the image data stream unscrambled, while 
scrambling the remaining part. In this case, since the 
partly scrambled data complies with the MPEG stand- 
ards, a malfunction or the brake-down of the decoding 
system can be avoided; furthermore, the receiver can 
easily recognize that the receiving data is scrambled 
image data. 

[0006] However, because the above method leaves 
part of the image data in a visible state, it is far from a 
complete scrambling of the image data. Additionally the 
selection of the part to be visible should be entrusted to 
the copyright holder of the image data to be scrambled. 

SUMMARY OF THE INVENTION 

[0007] It is therefore an object of the present invention 
to scramble an MPEG encoded image stream so that 
the scrambled data stream will comply with MPEG 
standards and an MPEG decoder will not malfunction or 



be broken down when scrambled data are input. It is 
another object of the present invention to scramble an 
MPEG encoded image stream so that a user receiving 
the scrambled data can distinguish the scrambled data 

5 from mere noise. It is another object of the present 
invention to enable the scrambling and unscrambling 
with simple circuits and at a low cost. 
[0008] In order to accomplish the above objects, the 
image scrambling apparatus of the present invention 

10 comprises: 

a first dividing decoder for dividing an MPEG 
encoded image data stream into a plurality of data 
segments; 

15 

at least one arrangement table recording arrange- 
ment information to be used for arranging the data 
segments; 

20 an arrangement circuit for arranging the data seg- 
ments output from the first dividing decoder in 
accordance with the information recorded in the 
arrangement table to output a scrambled image 
data stream; 

25 

a second dividing decoder for dividing the scram- 
bled image data stream into a plurality of data seg- 
ments; 

30 at least one rearrangement table recording rear- 
rangement information to be used for rearranging 
the data segments output from the second dividing 
decoder; and 

35 a rearrangement circuit for rearranging the data 
segments output from the second dividing decoder 
in accordance with the rearrangement information 
recorded in the rearrangement table. 

40 [0009] The first dividing decoder, the arrangement 
table, and the arrangement circuit may be included in a 
transmitter, and the second dividing decoder, the rear- 
rangement table, and the rearrangement circuit may be 
included in a receiver. However, the present invention is 

45 not limited to this construction, and all features may be 
contained in an apparatus or a system. 
[0010] According to this scrambling apparatus, the 
scrambled image data consists of data segments each 
of which complies with MPEG standards, and the 

so scrambled imaged data itself also complies with the 
MPEG standards. Therefore, an MPEG decoder receiv- 
ing the scrambled data will not malfunction or be broken 
down. 

[0011] Furthermore, although the scrambled image 
55 data is non viewable, because the image replayed from 
the scrambled image data visible, characteristic pattern 
which is different from that replayed from mere noise, 
users can easily distinguish the scrambled image data 
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from mere noise. Additionally, digital processing for 
dividing and arranging the image data stream is simple, 
and it is possible to simplify the circuit for the scrambling 
and unscrambling. 

[0012] In the scrambling apparatus of the present s 
invention, the first and second dividing decoder may 
divide the data stream into macro blocks or slices as the 
data segments. As shown in Figure 7, an MPEG 
encoded image data stream consists of a plurality of 
slices, and each slice consists of a plurality of macro 10 
blocks. In the general MPEG standards, each macro 
block consists of 16 x 16 pixels; however, the macro 
block to be used in the present invention is not limited to 
this size. 

[0013] By dividing an MPEG encoded image data is 
stream into a plurality of macro blocks and arranging the 
macro blocks so that each macro block is positioned at 
a position different from its original position in the data 
stream, it becomes impossible for an MPEG decoder to 
replay the image, even though the MPEG decoder will 20 
not malfunction and will not be broken down. The same 
effects can be obtained when dividing the image data 
stream into slices. 

[001 4] The scrambling apparatus of the present inven- 
tion may comprise a table transmitter and a table 25 
receiver. The table transmitter transmits the arrange- 
ment information recorded in the arrangement table to 
the table receiver, and the table receiver calculates the 
rearrangement information from the arrangement infor- 
mation and records the rearrangement information in 30 
the rearrangement table. In this case, it is easy to use 
various arrangement tables without complicated opera- 
tions at the receiver side. 

[0015] The scrambling apparatus may include a plu- 
rality of arrangement tables respectively recording vari- 35 
ous arrangement information different from each other 
and having table numbers different from each other. In 
this case, the table transmitter transmits to the table 
receiver only the table number corresponding to the 
arrangement table to be used. Next, the table receiver 40 
calculates the rearrangement information from the 
arrangement information recorded in the arrangement 
table corresponding to the received table number, and 
records the rearrangement information in the rearrange- 
ment table. 45 
[001 6] Another aspect of the present invention is an 
image scrambling method for scrambling an MPEG 
encoded image data stream, and this method com- 
prises the steps of: 

50 

providing an arrangement table recording arrange- 
ment information to be used 

dividing the MPEG encoded image data stream into 
a plurality of data segments; and 55 

arranging the data segments in accordance with 
the information recorded in the arrangement table 



4 

to output a scrambled image data stream. 

[001 7] Another aspect of the present invention is an 
image unscrambling method for unscrambling an image 
data stream scrambled by the above scrambling 
method, and this method comprises the steps of: 

dividing the scrambled image data stream into a 
plurality of data segments; 
providing a rearrangement table recording rear- 
rangement information to be used for rearranging 
the data segments; and 

rearranging the data segments in accordance with 
the information recorded in the rearrangement table 
to output an unscrambled image data stream. 

[0018] Another aspect of the present invention is a 
computer-readable medium containing computer-read- 
able instructions, and this medium comprises: 

means for causing a computer to provide an 
arrangement table recording arrangement informa- 
tion to be used; 

means for causing a computer to divide an MPEG 
encoded image data stream into a plurality of data 
segments; and 

means for causing a computer to arrange the data 
segments in accordance with the arrangement 
information recorded in the arrangement table to 
output a scrambled image data stream. 

[001 9] Another aspect of the present invention is a 
computer-readable medium containing computer-read- 
able instructions, and this medium comprises: 

means for causing a computer to divide a scram- 
bled image data stream into a plurality of data seg- 
ments; 

means for causing a computer to provide a rear- 
rangement table recording rearrangement informa- 
tion to be used for rearranging the data segments; 
and 

means for causing a computer to rearrange the 
data segments in accordance with the rearrange- 
ment information recorded in the rearrangement 
table to output an unscrambled image data stream. 

[0020] Each of the above aspects of the invention can 
accomplish the objects as described. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0021] 

Figure 1 is a block diagram of the image scrambling s 
apparatus according to the first embodiment of the 
present invention. 

Figure 2 is a block diagram of the image scrambling 
apparatus according to the second embodiment of 10 
the present invention. 

Figure 3 is a block diagram of the image scrambling 
apparatus according to the third embodiment of the 
present invention. is 

Figure 4 is a block diagram of the image scrambling 
apparatus according to the fourth embodiment of 
the present invention. 

20 

Figure 5 illustrates an example of the original 
MPEG image data stream and the scrambled data 
stream scrambled by the first embodiment. 

Figure 6 illustrates an example of the original 25 
MPEG image data stream and the scrambled data 
stream scrambled by the third embodiment. 

Figure 7 illustrates the relation between a picture, 
slices, and macro blocks in an MPEG encoded 30 
image data stream. 

Figure 8 illustrates an example of the original 
MPEG image data stream and the scrambled data 
stream scrambled by the first embodiment. 35 

Figure 9 illustrates an example of the original 
MPEG image data stream and the scrambled data 
stream scrambled by the third embodiment. 

40 

Figures 10A, 10B, and 10C respectively illustrate 
examples of the transmitting protocol which can be 
employed in the present invention. 

Figure 1 1 is a block diagram of an example of the 45 
arrangement circuit which can be employed in the 
first embodiment. 

Figure 1 2 is a flowchart of the arrangement process 
by the arrangement circuit shown in Figure 11. so 

Figure 1 3 is a flowchart of the rearrangement proc- 
ess by the rearrangement circuit. 

Figure 14 is a block diagram showing a system ss 
which can be employed for the embodiments of the 
present invention. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[First Embodiment] 

[0022] Figure 1 is a block diagram illustrating the best 
mode of the first embodiment of the scrambling appara- 
tus of the present invention, and this apparatus consists 
of a transmitter (or a transmitting system) for scrambling 
an MPEG-encoded image data stream, and a receiver 
(or a receiving system) for unscrambling the scrambled 
image data stream. 

[0023] The transmitter comprises an MPEG stream 
decoder 1 00a as a first dividing decoder for dividing an 
MPEG encoded image data stream into a plurality of 
data segments, an arrangement table 200 recording 
arrangement information to be used for arranging the 
data segments, and a macro block arrangement circuit 
300a as an arrangement circuit for arranging the data 
segments output from the MPEG stream decoder 100a 
in accordance with the arrangement information 
recorded in the arrangement table 200 to output a 
scrambled image data stream. 
[0024] The receiver comprises an MPEG stream 
decoder 1 00b as a second dividing decoder for dividing 
the scrambled image data stream into a plurality of data 
segments, a rearrangement table 210 recording rear- 
rangement information to be used for rearranging the 
data segments output from the MPEG stream decoder 
100b, a macro block rearrangement circuit 500b as a 
rearrangement circuit for rearranging the data segments 
output from the MPEG stream decoder 100b in accord- 
ance with the rearrangement information recorded in 
the rearrangement table 210, and an MPEG decoder 
700 for decoding the rearranged MPEG image data 
stream to reproduce the original image data. 
[0025] In the transmitter of the present embodiment, 
the MPEG stream decoder 100a receives, from an 
MPEG encoded data source (not shown), an MPEG 
encoded data stream produced by MPEG-encoding an 
image data stream, detects the top position of each of 
the macro blocks included in the MPEG encoded data 
stream by decoding the data stream using a macro 
block as a unit, and outputs timing signals so as to syn- 
chronize with the data stream. The macro block 
arrangement circuit 300a receives both the MPEG 
encoded data stream and the timing signals, arranges 
the data segments divided by the timing signal in 
accordance with the arrangement information, for 
example, as shown in Figure 5, and outputs a scram- 
bled image data stream. The bit length of each of the 
macro blocks is not constant; however, in Figure 5, the 
macro blocks are simply illustrated as if they have a con- 
stant length. 

[0026] Figure 8 illustrates an example of the arrange- 
ment of the macro blocks. The macro blocks are 
arranged in accordance with the arrangement informa- 
tion, and are respectively positioned at a position (p, q) 
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different from their original position (x, y) in the image. 
That is, the arrangement information is the information 
regarding the relation between (x, y) and (p, q). When 
an MPEG decoder having no unscrambling function 
receives the above scrambled data stream, the MPEG 5 
decoder reproduces confused images, and users can- 
not use the images. However, because each of the 
macro blocks contained in the scrambled data stream 
complies with the MPEG standards, the scrambled data 
stream does not adversely affect the MPEG decoder, 10 
and it is possible to avoid the malfunction or failure of 
the MPEG decoder. 

[0027] Although the macro block arrangement circuit 
300a of this embodiment performs the arrangement 
processing for all pictures contained in the MPEG 15 
image data stream, it is also possible to perform the 
arrangement processing for a selected part of the pic- 
tures, for example, only one picture, contained in the 
MPEG image data stream. Even in such a case, the 
scrambling effects can be obtained. 20 
[0028] The scrambled MPEG image data stream out- 
put by the arrangement circuit 300a may be transmitted 
directly to the MPEG stream decoder 100b, or may be 
stored in a suitable recording medium such as a CD- 
ROM, a DVD-ROM, a DVD-RAM, a memory, a floppy 25 
disk, a hard disk, or a magnetic tape. 
[0029] In the receiver of the present embodiment, the 
MPEG stream decoder 100b receives the scrambled 
image data which is transferred directly from the trans- 
mitter or is read out from the data storing medium, the 30 
MPEG stream decoder 100b detects the top position of 
each of the macro blocks included in the scrambled data 
stream by decoding the scrambled data stream using a 
macro block as a unit, and outputs timing signals so as 
to synchronize with the data stream. The macro block 35 
rearrangement circuit 500a receives both the scrambled 
data stream and the timing signals, rearranges the data 
segments divided by the timing signal in accordance 
with the rearrangement information to reproduce the 
original MPEG image data stream. Furthermore, the 40 
MPEG decoder circuit 700 receives the MPEG image 
data stream output from the rearrangement circuit 500a, 
and reproduces the visible image data on a display 
device such as a display. 

[0030] The details of the macro block rearrangement 45 
circuit 300a will be explained referring to Figures 1 1 and 
12. Figure 11 is a block diagram of the macro block rear- 
rangement circuit 300a, and Figure 12 is a flowchart of 
the process. In the following explanation, it is supposed 
that, every time the macro block arrangement circuit so 
300a finishes the arrangement of one frame of the 
MPEG image data stream, the circuit 300a receives an 
MPEG bit stream of the next frame. 
[0031] As shown in Figure 11, the macro block 
arrangement circuit 300a comprises; a stream memory 55 
13 for storing an MPEG data stream output from the 
MPEG stream decoder 100a; a bit counter for counting 
the number of bits contained in each macro block after 



initializing the bit number to 1 when receiving the timing 
signal; a top-address/bit-number memory 12 for storing 
both the top address of each macro block in the stream 
memory 1 3 and the bit number of the same macro block 
in the order of receiving the macro blocks; and a CPU 
14 for data processing among the elements 12, 13, and 
200, etc. It is also possible to use, instead of the CPU 
14, a sequential controller (or processor) having the 
same function as that of the CPU. 
[0032] Next, referring to Figure 12, the function of the 
macro block arrangement circuit 300a will be explained. 
In step S1 of Figure 12, the macro block arrangement 
circuit 300a initializes the bit number in the bit counter 
11 to "1" when receiving from the MPEG stream 
decoder 1 00a the timing signal corresponding to the top 
position of the next macro block. Then, the bit counter 
1 1 starts counting the bit number of the macro block in 
the MPEG image data stream, and simultaneously, the 
stream memory 1 3 starts storing the data of the same 
macro block. When the stream memory 13 finishes stor- 
ing all the data of the macro block, the top-address/bit- 
number memory 12 stores the bit number of the macro 
block and the top address (AD2) of the macro block in 
the stream memory 13. The CPU 14 controls the writing 
of the data into these memories while using, as triggers, 
the timing signal indicating the top of the macro blocks. 
[0033] In the next step S2, the CPU 14 determines 
whether the stream memory 13 has stored all data of 
one frame in the MPEG data stream, and if the decision 
is "NO", the macro block arrangement circuit 300a will 
repeat step S1 in order to perform the above process for 
the next macro block in the MPEG data stream. If the 
decision in step S2 is "YES", the macro block arrange- 
ment circuit 300a will perform the next step S3. 
[0034] In the S3, the CPU 14 reads out the arrange- 
ment information stored in the arrangement table 200. 
In the next step S4, the CPU 14 sequentially reads out 
both the top address of each macro block stored in the 
stream memory 13 and the bit number (length) of the 
macro block, from the top-address/bit-number memory 
12, in the order that the corresponding data in the 
arrangement information were read out from the 
arrangement table 200. 

[0035] In the next steps S5 and S6, the CPU 1 4 pro- 
duces readout addresses (AD3) of the stream memory 
1 3 based on the top addresses and the bit lengths of the 
macro blocks, and sequentially outputs the data of the 
macro blocks from the stream memory 13 in the order 
specified by the readout addresses (AD3). In the next 
step S7, the CPU 1 4 decides whether the all data is out- 
put from the stream memory 13, and if the decision is 
"YES", the arrangement process for one frame is fin- 
ished. If the decision is "NO", the steps S3-S6 are 
repeated until the decision becomes "YES". 
[0036] Next, the macro block rearrangement circuit 
500a shown in Figure 1 will be explained. The rear- 
rangement circuit 500a comprises the same hardware 
as that of the arrangement circuit 300a except that the 
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rearrangement table 210 (Figure 1) is used instead of 
the arrangement table 200; therefore, the overlapping 
explanations are omitted. 

[0037] Figure 13 is a flowchart of the function of the 
rearrangement circuit 500a. In step S11 of Figure 13, 
the macro block rearrangement circuit 500a initializes 
the bit number in the bit counter 1 1 to "1 " when receiv- 
ing from the MPEG stream decoder 100b (Figure 1) the 
timing signal corresponding to the top position of the 
next macro block. Then, the bit counter 1 1 starts count- 
ing the bit number of the macro block in the scrambled 
image data stream, and simultaneously, the stream 
memory 13 starts storing the data of the same macro 
block. When the stream memory 1 3 finishes storing all 
the data of the macro block, the top-address/bit-number 
memory 12 stores the bit number and the top address 
(AD2) of the macro block. The CPU 14 controls the writ- 
ing of the data into these memories while using, as trig- 
gers, the timing signal indicating the top of the macro 
blocks. 

[0038] In the next step S12, the CPU 14 determines 
whether the stream memory 13 has stored all the data 
of one frame in the scrambled data stream, and if the 
decision is "NO", the rearrangement circuit 500a will 
repeat step S1 1 in order to perform the above process 
for the next macro block in the scrambled data stream. If 
the decision in step S12 is "YES", the macro block rear- 
rangement circuit 500a will perform the next step S13. 
[0039] In step S13, the CPU 14 reads out the rear- 
rangement information stored in the rearrangement 
table 210. In the next step S14, the CPU 14 sequentially 
reads out both the top address and the bit number of the 
macro blocks, from the top-address/bit-number memory 
12, in the order in which the corresponding data in the 
rearrangement information was read out from the rear- 
rangement table 210. 

[0040] In the next steps S15 and S16, the CPU 14 pro- 
duces readout addresses (AD3) of the stream memory 
1 3 based on the top addresses and the bit lengths of the 
macro blocks, and sequentially outputs the data of the 
macro blocks from the stream memory 13 in the order 
specified by the readout addresses (AD3). In the next 
step S17, the CPU 14 decides whether the all data is 
output from the stream memory 13, and if the decision 
is "YES", the rearrangement process for one frame is 
finished. If the decision is "NO", the steps S13-S16 are 
repeated until the decision becomes "YES". 

[Second Embodiment] 

[0041] The second embodiment of the present inven- 
tion will be explained referring to Figures 2 and 1 0A- 
IOC. As shown in Figure 2, the second embodiment 
comprises, in addition to all the features of the first 
embodiment shown in Figure 1 , a table transmitter 400 
for transmitting to the receiver side the arrangement 
information stored in the arrangement table 200, and a 
table receiver 600 for receiving the arrangement infor- 



mation, composing the rearrangement information from 
the received arrangement information, and storing the 
rearrangement information in the rearrangement table 
210. 

5 [0042] In this embodiment, the macro block arrange- 
ment circuit 300a outputs a scrambled MPEG image 
data stream as in the first embodiment. Then, the table 
transmitter 400 transmits the arrangement information, 
which is used for the scrambling, to the table receiver 

10 600. The arrangement information may be transmitted 
together with the scrambled data stream, or it may be 
transmitted separately from the scrambled data stream. 
The table receiver 600 receives the arrangement infor- 
mation, calculates the rearrangement information from 

15 the arrangement information, and stores the rearrange- 
ment information in the rearrangement table 210. In this 
embodiment, because it is not necessary to use fixed 
rearrangement information, the degree of freedom of 
the scrambling process can be improved. 

20 [0043] After the rearrangement information is stored in 
the rearrangement table 210, as in the first embodi- 
ment, the macro block rearrangement circuit 500a 
receives the macro blocks divided by the MPEG stream 
decoder 100b, and rearranges the macro blocks 

25 according to the rearrangement information so as to 
output the unscrambled MPEG image data stream. 
Then, the MPEG decoder 700 reproduces the original 
image in a visible manner. 

[0044] Figures 10A-10C respectively illustrate proto- 

30 cols which can be used between the table transmitter 
400 and the table receiver 600. 
[0045] In the first protocol shown in Figure 10A, prior 
to transmitting the arrangement information, the table 
transmitter 400 transmits a transmitter start code to the 

35 table receiver 600. Then, the table receiver 600 trans- 
mits an acknowledgment code to the table transmitter 
400, and the table transmitter 400 starts transmitting the 
arrangement information to the table receiver 600 after 
receiving the acknowledgment code. The table receiver 

40 600 develops data elements of the arrangement infor- 
mation on the rearrangement table 210 to produce the 
rearrangement information. It is also possible to com- 
press or scramble the arrangement information before 
transmitting to the table receiver 600. 

45 [0046] In the second protocol shown in Figure 10B, 
the table transmitter 400 and the table receiver 600 
respectively store a common set of arrangement tables 
respectively recording arrangement information differ- 
ent from each other, and each of the arrangement 

so tables has a table number (or a table code), for exam- 
ple, one of the numbers from "1 " to "K". In this case, the 
table transmitter 400 may transmit only the table 
number to the table receiver 600, instead of transmitting 
all data in the arrangement table. Then, the table 

55 receiver 600 selects the arrangement table having the 
received table number, and unscrambles the scrambled 
data stream using the selected arrangement table. 
Therefore, in comparison with the protocol of Figure 
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10A, the amount of data to be transmitted can be con- 
siderably reduced. 

[0047] In the next protocol shown in Figure 10C, the 
table transmitter 400 outputs the arrangement informa- 
tion in the arrangement table or the table number of the 
selected arrangement table, and superimposes the data 
or the table number on the scrambled image data 
stream. In this case, after once instructing the start of 
the transmission, it is possible to transmit the arrange- 
ment information together with the scrambled image 
data stream. The superimposition method may be a 
method using video blanking signals, a method using 
MPEG system stream, or a method using electric water- 
marks embedded in the data stream. 
[0048] Although various transfer protocols can be 
used in the present invention as stated above, it is pref- 
erable to transmit only the table number instead of 
transmitting the arrangement information or its com- 
pressed (or scrambled) data, because the amount of 
data can be reduced. Furthermore, if the arrangement 
tables and their numbers are concealed, because third 
parties cannot procure the rearrangement information 
from the table number, it is difficult for the third parties to 
unscramble the data stream. 

[Third Embodiment] 

[0049] Figure 3 is a block diagram of the third embod- 
iment of the present invention. In this embodiment, the 
MPEG image data stream is divided into slices, instead 
of being divided into macro blocks, and is scrambled by 
arranging the slices. A slice is a "macro block line" 
which consists of a plurality of macro blocks arranged in 
one line in a picture as shown in Figure 7. 
[0050] This apparatus consists of a transmitter (or a 
transmitting system) for scrambling an MPEG-encoded 
image data stream, and a receiver (or a receiving sys- 
tem) for unscrambling the scrambled image data 
stream. 

[0051] The transmitter comprises an MPEG stream 
decoder 100c as a first dividing decoder for dividing an 
MPEG encoded image data stream into a plurality of 
macro block lines (= slices), an arrangement table 200 
recording arrangement information to be used for 
arranging the slices, and a slice arrangement circuit 
300b as an arrangement circuit for arranging the slices 
output from the MPEG stream decoder 100c in accord- 
ance with the arrangement information recorded in the 
arrangement table 200 to output a scrambled image 
data stream. 

[0052] The receiver comprises an MPEG stream 
decoder 1 0Od as a second dividing decoder for dividing 
the scrambled image data stream into a plurality of 
slices, a rearrangement table 210 recording rearrange- 
ment information to be used for rearranging the slices 
output from the MPEG stream decoder 100d, a slice 
rearrangement circuit 500b for rearranging the slices 
output from the MPEG stream decoder 100d in accord- 



ance with the rearrangement information recorded in 
the rearrangement table 210, and an MPEG decoder 
700 for decoding the rearranged MPEG image data 
stream to reproduce the original image data. 

5 [0053] In the transmitter of this embodiment, the 
MPEG stream decoder 100c divides an MPEG encoded 
image data stream into a plurality of slices as shown in 
Figure 7, and the slice arrangement circuit 300b 
arranges the slices in accordance with the arrangement 

10 information recorded in the arrangement table 200 to 
output a scrambled image data stream, as shown in Fig- 
ure 9. In the receiver, the MPEG stream decoder 100d 
divides again the scrambled image data stream into a 
plurality of slices, the slice rearrangement circuit 500b 

15 rearranges the slices in accordance with the rearrange- 
ment information recorded in the rearrangement table 
210, and the MPEG decoder 700 decodes the rear- 
ranged MPEG image data stream to reproduce the orig- 
inal image data. The other constructions are the same 

20 as those of the first embodiment. That is, the slice 
arrangement circuit 300b and the slice rearrangement 
circuit 500b have the same functions as those of the 
macro block arrangement circuit 300a and the macro 
block rearrangement circuit 500a in the first embodi- 

25 ment, except for using slices in place of macro blocks. 
Therefore, duplicated explanations are omitted. 
[0054] Figure 6 illustrates the original MPEG image 
data stream and the scrambled image data stream. The 
slices illustrated in Figure 6 have the same length as 

30 each other; however, the actual bit lengths may be dif- 
ferent from each other. Because the scrambled image 
data stream consists of slices which satisfy the MPEG 
standards, if the scrambled image data is input directly 
into an MPEG decoder, there is no risk that the MPEG 

35 decoder will malfunction or fail. Nonetheless the MPEG 
decoder cannot replay the original image because of 
the scrambling. 

[Fourth Embodiment] 

40 

[0055] Figure 4 is a block diagram of the fourth 
embodiment of the present invention, and this embodi- 
ment comprises, in addition to the construction of the 
third embodiment shown in Figure 3, a table transmitter 

45 400 for transmitting to the receiver side the arrangement 
information stored in the arrangement table 200, and a 
table receiver 600 for receiving the arrangement infor- 
mation, composing the rearrangement information from 
the received arrangement information, and storing the 

so rearrangement information in the rearrangement table 
210. 

[0056] In this embodiment, the slice arrangement cir- 
cuit 300b outputs a scrambled MPEG image data 
stream as in the third embodiment. Then, the table 
55 transmitter 400 transmits the arrangement information, 
which is used for the scrambling, to the table receiver 
600. The arrangement information may be transmitted 
together with the scrambled data stream, or it may be 
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transmitted as signals separate from the scrambled 
data stream. The table receiver 600 receives the 
arrangement information, calculates the rearrangement 
information from the arrangement information, and stor- 
ing the rearrangement information in the rearrangement 5 
table 210. In this embodiment, because it is not neces- 
sary to fix the rearrangement information, the degree of 
freedom of the scrambling process can be improved in 
comparison with the third embodiment. 
[0057] After the rearrangement information is stored in 10 
the rearrangement table 210, as in the third embodi- 
ment, the slice rearrangement circuit 500b receives the 
slices divided by the MPEG stream decoder 100c and 
rearranges the slices in according to the rearrangement 
information so as to output the unscrambled MPEG is 
image data stream. Furthermore, the MPEG decoder 
700 reproduces the original image in a visible manner. 
[0058] In this embodiment, it is possible to use the 
protocols such as those explained referring to Figures 
10A, 10B, and 10C. 20 
[0059] Figure 14 illustrates an example of the block 
diagram of the first and third embodiments in the case 
where computers are used. This example comprises an 
MPEG encoder 1000 for outputting an MPEG image 
data stream, a computer 900 for receiving the MPEG 25 
image data stream and performing the steps described 
in the first and third embodiments, a program storage 
medium 800 storing a program for performing the proc- 
esses shown in Figures 12 and 13, a data storage 
medium for storing the scrambled data output from the 30 
transmitter (this may be the computer 900 or another 
device), and an MPEG decoder 700 for reproducing the 
original image data stream by decoding the MPEG 
image data stream unscrambled by the computer 900. 
The program storage medium 800 and the data storage 35 
means 1100 may be a CD-ROM, a CDR, a DVD, a 
floppy disk, a magnetic tape, a hard disk, or the like. 
[0060] When this system is used as the transmitter of 
the first or third embodiment, the computer 900 loads a 
program for performing the processes shown in Figure 40 
12 and the arrangement table information from the pro- 
gram storage medium 800. Next, the computer 900 
receives an MPEG encoded image data stream from 
the MPEG encoder 1000, scrambles the MPEG image 
data in accordance with the process shown in Figure 45 
12, and outputs the scrambled image data stream to 
store it in the data storage medium 1 100, for example a 
CD-ROM. 

[0061 ] When this system is used as the receiver of the 
first or third embodiment, the computer 900 loads a pro- so 
gram for performing the processes shown in Figure 13 
and the rearrangement table information from the pro- 
gram storage medium 800. Next, the computer 900 
receives a scrambled image data stream from the data 
storage medium 1100, unscrambles the scrambled ss 
image data in accordance with the process shown in 
Figure 13, and outputs the original MPEG image data 
stream so as to replay it by the MPEG decoder 700. 



Instead of loading the rearrangement information from 
the program storage medium 800, it is also possible to 
load the rearrangement information from the data stor- 
age medium 1 100 or another source. 
[0062] The system shown in Figure 14 can also be 
used for the second and fourth embodiments of the 
present invention. In these cases, the computer 900 fur- 
ther comprises the functions of the table transmitter 400 
and the table receiver 600. That is, the computer 900 
stores the arrangement information in the data storage 
medium 1 1 00 when storing the scrambled image data in 
the data storage medium 1100, and the computer 900 
produces the rearrangement information using the 
arrangement information stored in the data storage 
medium 1 1 00 when replaying the scrambled image data 
stream. Of course, it is also possible for the computer to 
receive the arrangement information from other 
sources. 

Claims 

1 . An image scrambling apparatus for scrambling and 
unscrambling of an MPEG encoded image data 
stream, comprising: 

a first dividing decoder for dividing the MPEG 
encoded image data stream into a plurality of 
data segments; 

at least one arrangement table recording 
arrangement information to be used for arrang- 
ing the data segments; 

an arrangement circuit for arranging the data 
segments output from the first dividing decoder 
in accordance with the information recorded in 
the arrangement table to output a scrambled 
image data stream; 

a second dividing decoder for dividing the 
scrambled image data stream into a plurality of 
data segments; 

at least one rearrangement table recording 
rearrangement information to be used for rear- 
ranging the data segments output from the sec- 
ond dividing decoder; and 
a rearrangement circuit for rearranging the data 
segments output from the second dividing 
decoder in accordance with the rearrangement 
information recorded in the rearrangement 
table. 

2. The apparatus according to claim 1, wherein the 
first dividing decoder, the arrangement table, and 
the arrangement circuit are included in a transmit- 
ter, and the second dividing decoder, the rearrange- 
ment table, and the rearrangement circuit are 
included in a receiver. 

3. The apparatus according to claim 1, wherein the 
first and second dividing decoder divide the data 
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stream into macro blocks corresponding to the data 
segments. 

4. The apparatus according to claim 1, wherein the 
first and second dividing decoder divide the data s 
stream into slices corresponding to the data seg- 
ments. 

5. The apparatus according to claim 1, further com- 
prising: 10 



6. The apparatus according to claim 1, further com- 
prising: 



7. An image scrambling method for scrambling an 
MPEG encoded image data stream, comprising the 
steps of: 45 

providing an arrangement table recording 
arrangement information to be used; 
dividing the MPEG encoded image data stream 
into a plurality of data segments; and so 
arranging the data segments in accordance 
with the information recorded in the arrange- 
ment table to output a scrambled image data 
stream. 

55 

8. The method according to claim 7, wherein the data 
stream is divided into macro blocks corresponding 
to the data segments. 



9. The method according to claim 7, wherein the data 
stream is divided into slices corresponding to the 
data segments. 

10. An image unscrambling method for unscrambling 
an image data stream scrambled by the method of 
claim 7, comprising the steps of: 

dividing the scrambled image data stream into 
a plurality of data segments; 
providing a rearrangement table recording 
rearrangement information to be used for rear- 
ranging the data segments; and 
rearranging the data segments in accordance 
with the information recorded in the rearrange- 
ment table to output an unscrambled image 
data stream. 

11. A computer-readable medium containing compu- 
ter-readable instructions, comprising: 

means for causing a computer to provide an 
arrangement table recording arrangement 
information to be used; 

means for causing a computer to divide an 
MPEG encoded image data stream into a plu- 
rality of data segments; and 
means for causing a computer to arrange the 
data segments in accordance with the arrange- 
ment information recorded in the arrangement 
table to output a scrambled image data stream. 

12. A computer-readable medium containing compu- 
ter-readable instructions, comprising: 

means for causing a computer to divide a 
scrambled image data stream into a plurality of 
data segments; 

means for causing a computer to provide a 
rearrangement table recording rearrangement 
information to be used for rearranging the data 
segments; and 

means for causing a computer to rearrange the 
data segments in accordance with the rear- 
rangement information recorded in the rear- 
rangement table to output an unscrambled 
image data stream. 



a table transmitter for transmitting the arrange- 
ment information recorded in the arrangement 
table; and 

a table receiver for receiving the arrangement 15 
information transmitted from the table transmit- 
ter, calculating the rearrangement information 
from the arrangement information, and record- 
ing the rearrangement information in the rear- 
rangement table. 20 



a plurality of the arrangement tables respec- 25 
tively recording arrangement information differ- 
ent from each other and having table numbers 
different from each other; 

a table transmitter for transmitting the table 30 
number corresponding to the arrangement 
table to be used; and 

a table receiver for receiving the table number 
transmitted from the table transmitter, calculat- 35 
ing the rearrangement information from the 
arrangement information recorded in the 
arrangement table corresponding to the 
received table number, and recording the rear- 
rangement information in the rearrangement 40 
table. 
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